#Fixed Points
Research
Towards Looped Models Done Right — Part II: Rethinking at Fixed Points
Benhao Huang, Chufan Shi, Junlin Chen, Shicheng Wen, Zhengzhong Liu, Eric Xing, Xuezhe Ma
Looped LMs need not pay for every loop: near fixed points, they can scale FLOPs without scaling memory. Fixed-point shortcuts speed up training (pretraining, post-training) and inference (prefill, dec ...
